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(54) Media manager for access to multiple media types 



(57) Methods, systems and computer program 
products are provided which access media objects of a. 
plurality of media types stored at a plurality of locations 
accessible to a computer system through a common in- 
terface. Such a common interface may accept user input 
requesting a media object. Responsive to the user input 
requesting a media object, the location of a requested 
media object is automatically determined based upon 
an object identifier for the media object. Similarly, .the 
. type .of , media object may be automatically determined 
based upon the object identifier The determined loca- 
tion of the requested media object is then accessed to 
retrieve the media object the retrieved media object is 
formatted based upon the determined type of media ob- 
ject. .User transparent access to animations and media 
libraries are also provided at both local and remote lo- 
cations. .... - 
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started by , he United "state, S^ffi^^? " m 

Agency (ARPANET), it has only recentlv becomp » Zlr wJhh S - Advanced Research Project 

growth in use and traffic olTLZ^ZtlZto Z^L. c ™ n ' ca t™ medium. To a large extent, the explosive 
which is one of several sen! tee tec * ef or^l ^T, ^ ,hS 8ar ' y 1 "°' S of the worldwide web (WWW), 
services such as ele^onTZ ^^S^Z^^T ^ hdU * 3 V3riety ° f c °™«ion 

services such as WAIS andTcnie and a 1-tv STi T r9 ' ay ^ ( ' RC) ' a Varie,y of ^ormaHon search 
and Gopher. While ton^^^J^^J?^™ ^ r,8Val S8rVic8S such as FTP < file *ansfer protocol) 
has brought the Internet into ^ prominence ^«arch-onen.ed user we,,, the mu„imedia capabUity of the WWW 

.nternef) ^^a^^ 3 T*" °< "™ —ted to the 

pages. Specifically, web^S^^^^,^,! 0 - 0 -' T bf ° WSerS) WhiCh interfaCe the users with tn ° web 
(Netscape Comm^^SS^TlSSI ^ ™'^^ E,,P,0re * ^ Co W°") or ^igator® 
by a universal resource locator (URL) whfch notei^S th™ !! . 3 SerVSr rec * uestin 9 a web Page identified 
that server which ccmnr. M h. ^ ' ™ ^ ' '" e server wnere ,he web P^e resides and the file or files on 
which dis P .ays the web page to me usef ^ 9 °° Py °' ,he r9qUeS,ed fi,8 < s > lo ,he web b ^ser 

referred to as tags which can be us^d to con»!^l E? 7 1 t099,her W ' ,h embedded formatting commands, 
to weigh up the text, and so on A web J* """"P" 1 Whether teliC ° r bold >' h ™ 

the specified format. P H ™ L SCnpt ln order to dis P la V ^ text in accordance with 

for exam^lan EJ^JK^S or t a^eT' T* °' ^ » 3 ^ « ™«*"««» da ' a ' 

and displaying or paying the d^la^^l^^^* ,0 SUCh h a ^ ^ by 
rounding HTML text. Further information about HTManT^T t V ' tS ° Wn Web page ' without an V sur ' 
Douglas MacArthur, pp 1 8-26 and™ ^TbTjaJr^i n 1 ^ ^ be ,OUnd h Worirf ^ b V 
John Wiley Published, Ne« ^(799™ ^^''^^^^^^LSourcebookby Ian Graham, 

which is executed at the client rna*"e ^a^rSS ™\ P £ J" °? er W ° rdS> ,hey 9enera,ly do not conta ^ code 
the processing associated 5, 7oMeracZ E5E^J£\" ^ ^ ° ff, ° ad Onto the client ^ <* 

with their telephone number for examp^ hen a^ *! T" J"" 8 " ,he dient iS Completin 9 a *™ 

number are generally performed aTthe sender ™, IT t 35 *° ,he nUmber of di 9 its in the tele P h <™ 

time-consuming extra ^^to^^Z^^. h '? 3 T'" processin 9 burden at the server and in 
over, the inability of the^^^^S^?^" 3nd °'f ^ Should there be an V mist akes to correct. More- 
applications thauan be created toT P ^ ^ 31 the C ' ient iS a Si ^^ '^^ion on the type of 

temsTn^ h^^ J" ^ c ^tems, Inc.) techno.ogy from Sun Microsys- 

ming .anguage, somewhat simHar to rj TjoT^Tm a^E2Z?£ ^TT (i) 3 " eW Pre- 

programming language can be compiled ^S KS?. , Essentially, programs written in the Java 
chine. The Java virtual machine o^^^T^^ 1 lnterpreted at runt ime on the Java virtual ma- 
physical machine. * ^ COdeS ' nt ° instruc t'°ns that can be executed by the underlying 

Programs written using Java can be downloaded over the WWW in the form nf huto . < 

v,rtual machine at the client. Such programs are known as^toSeta^ T forexec "t'on on a Java 

code over the WWW has two major benefits An T , « ° f the JaVa technolo 9y for downloading 

has a copy of the Java virtual marine rthl vi^ T ? I 6 inde P ende "t, if we assume that each client 

the operate ^^S^S^S^Zi ^ " 6 " her into 

versions of the code for downloading .0^2 , £ th ■ ' ' e ' S "° need f ° r 8 S6rVer to have differe "t 
fore, only a single version of £ retevant code^S .n h « ^ T 6 ° Per3tin9 SyS,6mS a " d machines - There " 
veiopment. Because the rn B JnWne 4 which may simpiify software de- 

improved. Thus, when downkJdfn^ ^ oler thl u 3 PhySiCa ' machine « securit y is 9^ly 

code (accidentally or otherwlSlS Sv dTmaae da ^ " " * ^ 3 ri8k that * Wi " inC,ude some ma '"='^ 
can monitorthe operation ofmlLtr^^^^ 
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It will be noted that the concept of downloading software from a server to a client in the form of byte codes for 
execution on a virtual machine was also known independently of the Java technology. See for example U.S. Patent 
No. 5,347,632. 

In order to invoke a Java applet, a Web page of html text contains an <APPLET> tag, which identifies the URL 
5 containing the applet. A browser responds to this tag by retrieving and running the applet. Also defined is a <PARAM> 
tag, which is contained within apair of corresponding <APPLET> and </APPLET> tags, and which can be used to 
specify parameters that are passed to the applet at run-time. (Note that the APPLET and PARAM tags are not formally 
incorporated into the html standard, but are nevertheless recognised by many Web browsers). Further information 
about the Java technology and applets can be found in "Teach Yourself Java in 21 Days" by Laura Lemay and Charles 
10 Perkins (Sams.net Publishing, Indianapolis, Indiana, USA, 1996). 

Out.of an effort. to heighten the.sensory experience of the WWW, virtual reality modelling language (VRML, pro- 
nounced "VERtMEL") was developed. VRML: is a standardized language for describing animation and three dimen- 
sional modelling of geometric objects. VRML allows a three dimensional scene or world(s) to be manipulated in an 
-interactive manner overthe Internet or locally. In either case VRML allows for the creation of virtual environments which 
is may be shared by multiple users. Thus, unlike HTML. which' provides for relaying and formatting text and images, and 
for hyperlinks to other web pages, VRML provides for the organization of three dimensional objects and scenes in a 
hierarchicalfashion that may be truly interactive. 

What each of these various forms of data on the Internet have in common is the use of multiple media types in 
their interaction with a user. For example, HTML, Java, or VRML all may utilize images, sound, text and even animations 
20 (a series of images successively played for a user) in providing information to a user. The media accessed typically 
takes the form of media files located locally on a user's computer, on a server connected to the user's computer or on 
athird party server accessed through the serve ^connected to the user's computer. 

Typically, the burden has been placed on the individual programmer to handle the different scenarios that result 
from the possible locations of media files. This burden has typically been discharged by the programmer writing different 
25 code-to handle the various possibilities. This code differs for each ofthe possible scenarios and. may also differ de- 
spending upon the format of the media file to be accessed. 

..One traditional.manner in which Java applets have dealt with multiple media.files is for the programmer to surface 
the different locations to the end user. The end user then becomes responsible for understanding the complexities of 
. ..media files being located at one or more of the possible locations. However, such a solution adds complexities to the 
30 . end user. without relieving the programmer of the burden of handling the different file locations. 

With respect to accessing particular media types, a particular problem arises with respect to the accessrof anima- 
tions. Animations are typically composed of.a sequence of image files that are presented in a "flip book" format in order 
, to-simulate motion, The tools conventionally used to create animations may force the end user to -explicitly specify 
each of the individual images (or /animation cells) of the animation^ be created. Alternatively these tools may force 
35 the user to implement one numbering scheme" for their image files. Conventional tools alsotypically limit the-number 
of jmages that can be specified for use in an animation by a;p redefined upper bound. In either case, the programmer 
has surfaced to the end user the rigidity with which they have provided support for grouping and loading image files 
used in creating animations. 

. As.an example of the. conventional managements images, in AimTech's Jamba™ an animation is given a first 
40 image file name and only nine additional associated image files specified by the numbering scheme that is incorporated 
; in the file name may be incorporated in the animation. .Furthermore, conventional tools may only create animations 
from image files located locally on the user's computer system. , ■ - ■ : - 

A third concern with respect to media management is support for versions of an application where the only change 
in the versions is the media content accessed by the application. Conventionally, such versions have been supported 
45 by the programmer changing references in the code to match each of the changes in the media content. As is apparent, 
such a labor intense manner of revision may quickly become costly as the number of different versions supported 
, increases. . . : ' • ' ' ' *' 

v.. In light of the above discussion, a need exists for improvement in the accessing of multiple media types over 
networks such as the Internet. These improvements are needed in accessing multiple media types, creating animations 
50 and supporting various versions of applications. 

In view of the above discussion, it is an object of the present invention to provide for the uniform control of multiple 
media types. 

Another object of the present invention is to provide a simpler interface for programmers creating multimedia 
programs. 

55 still another object of the present invention is to provide increased flexibility in media access for multiple media 

types. . 

Yet another object of the present invention is to provide such flexibility without increasing the programming re- 
quirements of multimedia applications or applets. 
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uctsacc^ng ^SS^ST^ * SyStemS and c< « P"8»n prod- 
•«°r*.iaplX^ '° ^ ^ °' 3 P,Ura,i * * media 'VP- 
may accept user input requesting V U9h 3 COmm ° n interface Such a common interface 
of a requested med* obl^ ^ ^.T' requestina a media <*ject, the location 
the type of media objec may STSSSiKSnS^ T ^ ldentlfler f ° r ,he media ob > ecl Similar V. 
of the requested media object is C accessed treZv^h! T" ° bi8Ct The location 
based upon the determined type o^meS otject ^ m6dia ° bjeCt is ,orma " ed 

object. In such a case, the conn^XliS^rS^n * nB t bM6d Upon the determined type of media 
the media object is an audio obiec Alsc , iL ™S ^ Stream connecti °n « the determined type of 

determined type of t^S^^^SS > ° "*> * ^ S,rSam CM °" the 

loeaS.^aTnrS,S2S to'^coZf Y * ^'^ IOCal l ° « he ""P"*' system 

through the server l0Ca,i0ns ,ocal to a * ird P"* 

server accessible 

stored at a third party server then alesTi™ Z £S h? embodiments, if the requested media object is 

of the third part/server ^'^S^^Z^ ZSZTi? aCC ° mp ' ished * va,idatin 9 the location 
from the third party server. connect.on to the third party. The requested media may then be retrieved 

idenl~^ - - nested media objec, based upon an object 

Similarly, the determination of i^^^SXS^ k " h SpeCtf,Cation of a filena ™ °< the media object, 
evaluating an extension of a m^rtZTeTo^T " ^ ^ ^ id8n,Htor C ° mprises the ^ * 

for Z!^!^^Tn r ia in,ormation independent of the -P— 

automatical* formatting thlm^^ l ° 9 P"°rammer. Furthermore, by 

medlaoS;^ 

identified images until the next con^u^^S^ anima tion media object is retrieved. Consecutively 

* number of the next consecutively * retrieVed 3nd 3 predefined 

spondstothenumberof images in the animat ^ predefined number of retrieved images corre- 

embodiment of the present invention the^onsecuVlX h e t d ; ma9esma y beformat ted as an animation. In a particular 
from the computer system consecut,vely ,dent,f,ed .mages are retrieved from a storage location remote 

animation, the animation may Jr^e^fro^^ Lch as"^ LT ^ '5 """^ ° f im396S in an 

overcomes the animation limitations of previous ^S^S^S^T ™™ ' *" PrSSent hV8nHon 

™* library and media infor- 

between versions of an applicatbn may to reduced as ontv The mei dlSadVa " ,39es of revisi <™ to media content 
acce^r=^ 

■ocations at a server remofe to a to the C ^ ^stem or storage 

based upon the media type stored aUhTSaStSZ 7 " 9 ^ ,nformation store d at a storage location 
for determining which typL tie ms ia types ^stofed It a s . " r** 0 *" 8 " 1 ' ^ madla 300688 pr ° 9ram '° 9ic 
a file extension in a filename of the " ^ SU ° h determina «on based upon 

may also access a storage location blsT^ o^Zt T "T™ ^ f ° r 3CCeSSin9 Stora 9 e ,ocatio " s 
stored information. P P3th ,n,ormatlon and a file identifier contained in a filename of the 

in another embodiment of the present invents, the media access Cass further inc.udes media access program 
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logic for retrieving animation image files. Such media access program logic for retrieving animation image files may 
include media access program logic for retrieving sequentially identified image files until a break in the sequence is 
detected The media access program logic for retrieving animation image files may also include media access program 
logic for retrieving sequentially identified image files based upon an initial image file identifier and the number of image 
files in the.animation. The animations image files may, therefore, be retrieved from a location remote from the computer 
. system. 

In yet another embodiment of the present invention, the media access class further includes media access program 
logic for accessing a media content library based upon indices into the media content library. 

Embodiments ol the invention will now be described with reference to the accompanying drawings, in which: 

Figure 1 is block diagram of a processing system utilizing the present invention; 

Figure 2 is a block diagram of a network environment having a processing system utilizing the present invention; 

is Figure 3 is.a flow chart of the operations of one embodiment of the present invention; 

...... Fi gure 4 is a flow chart. of the operations of a connection establishing aspect of the present invention; 

Figure. 5 is a flow chart of a data formatting aspect of the present invention; 

20 

Figure 6 is a flow- chart- of an animation aspect of the present invention; 

Figure 7 through Figure .10 are a screen images of a user interface utilizing the present invention; and 
25 Figure 11 A and Figure 11 B are screen images of uses of a media library. 

The present.invention now will be described more fully .hereinaftenwith reference to the accompany ing:drawings, 
- in which like numbers refer to like elements throughout. As will be appreciated by one of skill in the art, the present 
invention maybe embodied as methods or devices. Accordingly, the presentinvention may take the form of an entirely 
30 hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. 

Throughout the description of the preferred embodiments of the,present invention and the summary of the present 
invention, reference is made to user input. -As used herein user input may-be direct or indirect imthat the input may be 
directly input by a user or it may be indirectly input by an application run by a user or other application. 

Figure 1 illustrates a data processing system on which virtual environments.according to.the present; invention 
35 may be utilized As seen in Figure 1 . illustrates a computer system 15 having a data processor 20 which may include 
an operating system 21 resident in the processor. An application 22 may be running on the operating system 21 . The 
processor 20 displays information on a display device 23. The -display device 23 has a plurality of picture elements 
- (collectively referred to as a screen) which may define *he appearance of,a user interface environment displayed on 
the display device. .For each, picture element a color characteristics of that element. includes hue, brightness, and 
40 saturation values By manipulation of these values for each picture element of the screen the appearance or contents 
of the screen is established. The contents of the screen of the display device,23 and, therefore, the appearanceof the 
user interface environment, may be controlled or altered by the application 22 or the operating system 21-either indi- 
vidually or in combination. r .... - -' v ' - ' 5 " ' 
. For obtaining input from a user, the operating -system 21 ..the application 22 or both may utilize user input devices 
45 **; 24. User input devices 24 may include a pointing device 25 and a keyboard 26 or other input devices known to those 
. of skill in the art User input devices 24 may be used to provide user, input to the application or operating system to 
/ ' control the operation of -the computer system 15. Output devices.in addition to the display device 23 may also be 
provided for providing additional output to a user. For example, a sound device and speakers may be utilized to provide 

audio to a user.- . • , ' ... 

so \ Figure 1 also illustrates a communications interface 27 associated with the processor 20 which may be utilized to 
send and receive communications with devices external to the processing system. Communications interface 27 may 
be a network interface, a modem, a serial port, a parallel port or any other means of sending and receiving information. 

Figure 2 illustrates how computer system 1 5 may be interconnected to a network of computers. As seen in Figure 
2 computer system 15 may communicate with a server 30 over its communications interface 27. Server 30 may have 

ss access to the Internet and may, therefore, provide access to the Internet from Computer 15. As will be appreciated by 
those of skill in the art, server 30 may also be a proxy, which provides access to the Internet to computer 15. Through 
its access to the Internet, computer 1 5 and server 30 may also have access to a third party server 40. Thus, computer 
system 15 may access information located on computer system 15, on the connected server 30 or on a third party 



5 



10 



15 



20 



25 



30 



35 



40 



45 



SO 



55 



BP 0 889 420 A2 

m^ r ^'2?to inVenti ° n - dmerenCeS ln « e ~"'» ™ dia ^ at »»" --us .ocations may be 

of a plurlZT^^^ Z SyStSm " Uti ' iZin9 ,he Pr8Sent inV6ntion may P rovide transparent access to media files 

aspects o the rST,i? in 1 f S IOCat '° nS indUdin9 '° Cally ' 0n Server 30 or on sefVer 40 Furthermore, utilizing 
aspects of the present invention, computer system 15 may utilize animations of varying numbers of imaaes and with 
.mages located on locally, on server 30 or on server 40. Such locations may be a^S^^S^S^Z 
creatmg such an.mat.ons. Furthermore, according to the present invention, various versions oiappi^ac^Z 
media may be supported without revision to the application applications accessing 

The present invention will now be described with respect to Figures 3 through 6 which are flowchart illustrations 
of one embod.ment of the present invention. As is seen in Figure 3, a media mana^acco^^Z^rSS 
recedes a request to access media information (block 50). The media manager validates hfre^ 

ITrJ^'J^J^ ^ efr0r (b T k 54) - VaHdati0n ° f thS ^ ™* S thetcationo 

^^S^^uSSK mZCct 3 m6dia ° bjeCt '° Cated ° n " ^ S8rVer ' SUCh " 4 °' 

If the connection is valid, then the media manager establishes the appropriate connection type (block 561 Th« 
connection type established may depend upon the type of media accessed. For example T^mSK a!^E 
hen an audio stream connection may be established. The detai.s of establishing the proper connect on a^e iHus °a^S 

biocTsa 4 a Thi r/rT e, r 

Selurn^o SSSSS ^ *" ^ * *** "> *" ^ ** 

For J™? a ^rSu ""V**™ 1 ™ the location of the ™<*a object file utilizing the filename of the media object 

Z«~Z^r^. " Ut " i2ed t0 ~ - *" J > *- - a ~e 8 r a^ 

of thl^esTocZn^nHt™ 9 ^ aCC °;f n9 *° thS Pfesent inven,ion ma V automatically access the media file independent 
™ i * h transparent to the user. For example, in the case of the file location as the remote third party 
server 40 the med.a manager would create a connection to the remote URL setting up the correct promote eaSIhe 
Z I ! 96 k n t C ° nVert th6 data t0 the a PP r °P"ate file format and provide the data t h SlST! 

the media object « located on the remote se,ver 30 then the location of the file is well known and just needs to be 
retrieved from the server. If the file is located locally then all that need be done is to determine the . (£i2Em£ for 
^f-teandhandle the format appropriately. Thus, connection to the file may take varying fo^^^^^ 

tvoe ofmedia thaTlTon^ of block56 of "9«"e 3- As seen in Figure 4, the media manager determines the 

type of media that is to be accessed and establishes the appropriate connection based on the type of media In block 
70 it .s determined ,f the media type is audio and if so an audio stream connection is set ?^«2nSti^2S 
?n fmfrT S t (b ^ k ?2) - " the m6dia l ° bS aCC6SSed is not audi °- » the media typeTs a Mmage CS 

TO^atT!!, a 0 ^ Wn8to ? eS,abliSh9d ^ SSt UP Wfth th8 C ° rrect bit depth P«'s (bloci 

76)_ Sim.larly, .f the med.a manager determines that the media type is text (block 78) then a text stream is estab ished 

wrth the appropriate connection parameters (block 80). As is reflected by block 82, other types oi '3a mat aTo be 

%szs^%^sr* in r ention with the appropriate connecti ° n ^ ^^^ssz^ 

media eaues^LnJ 1 1 1 P ^T ' m6nU ° n a " ^ need be aVailable is a mechanism for determining the type of 
media requested and a mechanism for establishing the proper connection for that data 

According to the present invention, the type of media requested may be determined from the extension of the 

eSor! rrZ 7 8 h T jeCt ThUS> f ° r eXample ' 3 " JPG " eXtension would indica 'e an image" ll Si^a "WAV- 
extens on may ind.cate an audio file. Thus, from the filename extension the lype of media to be accessed mlv be 
determined and the appropriate connection established for that media type making the connection ^renUo the 

Figure 5 illustrates one embodiment of the formatting operation of block 60 of Figure 3 As seen in Fiaure 5 it 
may be determined , the media type is audio media (biock 90) and the type of audio ^VJ^^SSl£ 

tTamvfoZTbS 

IhJ ffii AVf0fmat (b . IOck ® 6) - s,m "arly, if the audio file is an audio clip format, the then, based on the "ALT extension of 
the filename,, the b.nary formatted file could be converted to an AU format (block 94) extension of 

100 ^^TAaS^ ^ r de !fT ed at bl0ck *• then the <* ""age file may be determined (biock 
7i o , . ' 38 s P eclf,ed b V th e 'JPG" filename extension, then the binary data is formatted to the 

As is seen in blocks 106, 108, 110 and 112. other formats of data for other media types may also be utilized with 
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the present invention. As seen in block 106 text formatted data may be identified and converted (block 108). Similarly, 
other data formats may be identified (block 110) and appropriately converted (block 112). 

According to the present invention, the format of the type of media requested may be determined from the extension 
of the filename of the media object file. For example, a "JPG" extension would indicate a JPEG image file. Similarly, 

s a "WAV" extension, may indicate a wave table audio file. Thus, from the filename extension the format of the type of 
media to be formatted may be determined and the data appropriately formatted to the specified media format making 
the formatting of the .data transparent to the user. 

The present invention has been described above with respect to specific formats of media data. However, as will 
be appreciated by those of skill in the art, other formats of media data such as TIF image files and the like may be 

10 utiltzed with the present invention. .All that need be known to make the formatting of the data transparent to the user 
is the end format for the data and how to convert from the source data to the end format. * 

Figure 6 illustrates a further embodiment of the present invention which may be utilized to manage animations. 
As seen in Figure 6, the media manager determines if the media request is for an animation (block 120). If -'the -media 
object is an animation then the first image of the animation is retrieved (block 122). Images are then retrieved until a 

*5 gap in the sequence of -images is reached (block 1 24). These sequential images may:then be considered the animation 
and may be formatted or otherwise processed as described above. The break in the sequence of images may be 
determined by examining the location of the.images to determine, based upon the filename of the image, if the image 
is sequentially identified by the filename. Thus, for example, a filename such as IMAGE01 .GIF may be the first image 
in theanimation followed by IMAGE02.GIF and so on. When a break in the numbering of the image files is reached 

20 the media manager, may use.that break to indicate the end of the animation. 

.Such an animation mechanism may be readily utilized for animations which are local. However, certain .program- 
ming languages, such as Java, may prevent access to animations which are stored remotely. The media manager of 
the present invention may account for this limitation if the number of images in the animation are provided to the media 
manager. Thus, by utilizing the filename of the animation images and the number of images in the animation, the media 

2s manager may assume the existence of the/sequentially numbered image files at the remote location and retrieve them 
for use. For example, if there are 5 image files in an animation and the first image file is named IMAGE10.JPG, then 
the media manager will assume that the animation includes image files IMAGE11.JPG, IMAGE12.JPG, IMAGE13.JPG 
and IMAGE14.JPG. These files will be retrieved from the remote location as if they are individual images-and then 
incorporated into the animation. Thus, the remote location limitations of existing programming languages may be over- 

30 come utilizing the present invention. . : . . 

Additionally, the media manager of the present invention may allow for the creation of media libraries. In such a 
case : a media library allows the programmer to group media content into a selfncontaining/managing library. Various 
media libraries can contain the same media references only differing in how the media looks or sounds. Thus, a pro- 
grammer can make one reference to media content and it will always be valid as long as the media library is present. 

35 For example, rf a programmer has developed an application that educates an end user about Beethoven, all of 

the media content of the application may be contained in a media library (Figure 11 A). References to the media may 
be done to indices into the library. Thus, the same application may be utilized to educate an end user about, for example, 
Bach, by changing the media library (Figure 11 B) while maintaining the same indices. 

A media library is a collection of media elements (audio, image, text, etc... files) that is combined into a single 

40 entity(file), such that the data for each media element is arranged in the file by the name of the media. The file can be 
reduced for size and download time by using some form of compression when the media data is stored into the media 
library. The internals of a media library can be implemented in any of a number of ways known to those of skill in the 
art. One such way, is for the media library to be a class. The media library class could contain all of the media data in 
a hashtable where the key is the media element and the value is the name of the file and the data from the file. The 

45 media library class can have methods for adding and deleting media to/from a media library. Additionally there can be 
methods for accessing(retrieving) the data for the media out of a media library using the name of the media as a lookup 
key. 

The way a media library is created depends on the way the internals of a media library are implemented. One such 
way is for a rfiedia library to be created by a dialog window that displays a grid (Figure 11 A). The name of the media 
so element can be entered and the media file associated with that media element can be entered. 

Such a media library may be accessed by a program which references the media library and the media name. For 
example, from the Beanmachine™ illustrated interface (Figure 8 discussed below), instead of specifying an image 
file, the user could specify a media library in 225. After selecting the media library, a dialog window is shown which 
displays all of the media in the selected media library, and allows the user to select which media element out of the 
55 library is to be used. This information (media library and media element) is then given to the media manager for it to 
load the media via the media library's access methods. 

The use of the present invention may be illustrated in the screen captures provided as Figure 7 through Figure 
10. As seen in Figure 7, in Lotus™ Beanmachine™, there is a single picture property 220 where the end user can 
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An example of a class according to the present invention is as follows: 



class FileNameWrapper () { 
30 String path; 

String filename; 
String extension; 
boolean is URL; 
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public FileNamewrapper (string f ileRef erence) 
{ path = extractPatMf ileRef erence) ; 

iaURL = locatePath (path) ; 

filename = extractFilename (f ileRef erence) ; 
extension = extractExtens ion (f ileRef erence) ; ; 
} 

String extractPath (String f ileRef erence) 
{ 

// method extracts path information from file reference passed 



String ex tractF ilename (String ,f ileRef erence) 

"{ , . .. - ... . - , • : ■ . - ■ 

// method extracts file name information from file reference 

passed 

} 

String extractExtens ion {String f ileRef erence) 
{ 

// method extracts extension information from file reference 

passed . ... „ ^ >; '" • - 

1 .. • ,-, .. • . - ■ ■ ■ ' -v. ■ : ■ - - 

Boolean locatePath ( string path) 
{ 

// method determines whether file is located at a URL or on 
local file system " 
} 

class MediaManager O 

{ . , ... .. , • * 

Image ge tlmage ( F i 1 eNamewrapper imageF i 1 e ) 

// method gets image from file and a tores /re turns in an image 
. obj ect k 
} 

AudioC lip get Audio (FileNameWrapper audioFile) 
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// method gets audio clip from fi le and stores/returns in an 
audio clip object 



Text getText(FiieNamewrapper textFile) 
{ 

// method gets text from file and stores/returns in a text 

object 

} 
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Animation getAnimation<FileNameWrapper f irstrmageFiie, 

// method gets all sequentially numbered image files with the 
f irstlmageFile that is passed in and stores/returns all in an animation 

object; utilizes getlmageO 
} 

Animation getAnimationfFileNameWrapper f irstrmageFiie, int 
numOf AnimationFramee ) 
{ 

// method determines name of numOf AnimationFrames sequentially 
numbered image files after the f irstlmageFile and then proceeds to load 
in*ge files from remote location; all iina ges retrieved are stored and 
returned in an animation object; utilizes getlmageO 

} 

Object getMediaElementfFileNameWrapper mediaLibFile, int 
medialndex) 

{ 

// method retrieves media object stored at index medialndex 
within the media library referenced by mediaLibFile 
} 

Object getMedia (FileNamewrapper mediaFilename) 
{ 

// method returns appropriate media object based upon media 
stored in given file, mediarilename; utilizes previous ly defined methods 
for actually returning correct object 

if ( //image ) 
{ 

return ( get image (mediaFilename) ); 
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) 

else if ( //audio ) 
{ 

return ( getAudio (mediaFilename) ); 

} - 

else if ( ( //text ) , 
{ 

return ( get Text (mediaFilename) ) ; 



........... . } • , ;• ■ 

} ' 

25 ■■ : ■ : 

It will be understood that each block of the flowchart illustrations of Figures 3 to 6, and combinations of blocks in 
the flowchart illustrations, . can be implemented by computer program instructions. These program instructions may be 
provided to a processor to produce a machine, such that the instructions which execute on the processor create means 
for implementing the functions specified in the flowchart block or blocks. The computer program instructions may be 

30 executed by a processor to cause a series of operational steps to be performed by the processor to produce a computer 
implemented process such that the instructions which execute on the processor provide steps for implementing the 
functions specified in the flowchart block or blocks. 

Accordingly, blocks of the flowchart i I lust rations support combinations of : means for perform ing the specified func- 
tions, combinations of steps for performing the specified functions and program instruction means for performing the 

35 specified functions. It will also be understood that each block of the flowchart illustrations, and combinatjons of blocks 
in the flowchart illustrations, can be implemented by special purpose hardware-based systems which perform the 
specified functions or steps, or combinations of special purpose hardware and computer instructions. • 

40 Claims 

1. Anapparatus for use in a computer system having a memory and having access to a plurality of media types, the 
apparatus comprising: . : : . . ■*■■ • ' -' ;r - ! - ^ l ' 

45 media access class information stored in memory, said media class information including media access pro- 

gram logic for accessing storage locations where :the plurality of media types are stored and wherein the 
storage locations where the plurality of media types are stored include storage locations local to the computer 
system, storage locations at a server connected to the computer system or storage locations at a server remote 
to.a server connected to the computer system. - 

so . . \- _ i. . , * .. ■ >. 1 * -■ - ■ '•*■" • ' : • • ' •• • ' 

2. An apparatus according to Claim 1, wherein said media access class further comprises media access program 
logic for determining which type of the media types is stored at a storage location and for formatting the information 
stored at a storage location based upon the media type stored at the storage location. 

55 3. An apparatus according to Claim 2, wherein said media access program logic for determining which type of the 
media types is stored at a storage location makes such determination based upon a file extension in a filename 
of the stored information. 
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4. An apparatus according to Claim 1 wherein said media access class further comprises media access program 
logic for retrieving animation image files. 

5. An apparatus according to Claim 4, wherein said media access program logic for retrieving animation image files 
includes media access program logic for retrieving sequentially identified image files until a break in the sequence 
is detected. 

6. An apparatus according to Claim 4, wherein said media access program logic for retrieving animation image files 
includes media access program logic for retrieving sequentially identified image files based upon an initial image 
file identifier and the number of image files in the animation. 

7. An apparatus according to Claim 6, wherein the image files are retrieved from a location remote from the computer 
system. 

8. An apparatus according to Claim 1 , wherein said media access class further comprises media access program 
logic for access a media content library based upon indices into the media content library. 

9. An apparatus according to Claim 1 , wherein said media access program logic for accessing storage locations 
accesses a storage location based upon path information and a file identifier contained in a filename of the stored 

20 information. 

10. A method of accessing media objects of a plurality of media types stored at a plurality of locations accessible to 
a computer system through a common interface, the method comprising the steps of: 

accepting user input requesting a media object; 

responsive to the user input requesting a media object, automatically carrying out the steps of: 
determining the location of a requested media object based upon an object identifier for the media object; 
determining the type of media object based upon the object identifier; 

accessing the determined location of the requested media object to retrieve the media object; and 
formatting the retrieved media object based upon the determined type of media object. 

11. A method according to Claim 10, wherein said step of accessing the determined location comprises the steps of 
establishing a connection to the determined location wherein the type of connection established is based upon 
the determined type of media object. 

1 2. A method according to Claim 1 1 , wherein said step of establishing a connection comprises the step of establishing 
an audio stream connection if the determined type of the media object is an audio object or establishing an image 
stream connection if the determined type of the media object is an image object. 

13. A method according to Claim 10 wherein the plurality of locations includes local to the computer system local to 
a server connected to the computer system and local to a third party server accessible through the server connected 
to the computer system. 

14. A method according to Claim 1 3, wherein said step of determining the location of a requested media object deter- 
mines that the requested media object is stored at a third party server and wherein said step of accessing the 
determined location comprises the steps of: 

validating the location of the third party server; 

establishing a connection to the third party; and 

retrieving the requested media from the third party server. 
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15. A method according to Claim 10, wherein said step of determining the location of a requested media object based 
upon an object identifier for the media object comprises the step of evaluating a path specification of a filename 
of the media object. 

16. A method according to Claim 10, wherein said step of determining the type of media object based upon the object 
identifier comprises the step of evaluating an extension of a filename of the media object. 

17. A method according to Claim 10, wherein if said step of determining the type of media object determines that the 
media object is an animation media object, the method further comprising the steps of: 



retrieving a first of a plurality of images included in the animation media object; 

retrieving consecutively identified images until the next consecutively identified image is unavailable; and 
is formatting the consecutively identified images as an animation. 

18. A method according to Claim 10, wherein if said step of determining the type of media object determines that the 
media object is an animation media object, the method further comprising the steps of: 

so retrieving a first of a plurality of images included in the animation media object; 

retrieving a predefined number of the next consecutively identified images, wherein the predefined number 
corresponds to the number of images in the animation; and 

25 formatting the retrieved images as an animation. 

19. A method according to Claim 18, wherein said step of retrieving a first of a plurality of images and said step of 
retrieving a predefined number of the next consecutively identified images retrieve the images from a storage 
location remote from the computer system. 



20. A method according to Claim 10, wherein the user input comprises indices into a media library. 



21. A computer program product for accessing media objects of a plurality of media types stored at a plurality of 
locations accessible to a computer system through a common interface comprising: 
35 j 

a computer readable storage medium having computer-readable program code means embodied in said me- 
dium, said computer-readable program code means comprising: 



computer-readable program code means for accepting user input requesting a media object; 

computer-readable program code means, responsive to the computer-readable program code means for ac- 
cepting user input requesting a media object, for automatically determining the location of a requested media 
object based upon an object identifier for the media object; 

45 computer-readable program code means, responsive to the computer-readable program code means for accepting 

user input requesting a media object, for automatically for determining the type of media object based upon the 
object identifier; 

computer-readable program code means, responsive to the computer-readable program code means for ac- 
so cepting user input requesting a media object, for automatically accessing the determined location of the re- 

quested media object to retrieve the media object; and 

computer-readable program code means, responsive to the computer-readable program code means for ac- 
cepting user input requesting a media object, for automatically formatting the retrieved media object based 
ss upon the determined type of media object. 

22. A class object executing on an object oriented computer system for accessing a plurality of media types, the class 
object comprising: 
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